System and method for virtual interfaces and advanced smart routing in a global virtual network

ABSTRACT

Systems and methods for connecting devices via a virtual global network are disclosed. In one embodiment the network system may comprise an endpoint device including a tunnel manager and a first virtual interface, an access point server including at least one tunnel listener and a second virtual interface. One or more tunnels are formed connecting the tunnel managers and tunnel listeners. The virtual interfaces provide a logical point of access to the one or more tunnels.

This application is a U.S. National Stage application under 35 U.S.C. §371 of International Patent Application No. PCT/IB2016/000531, filed,Apr. 7, 2016, which claims the benefit of and priority to U.S.Provisional Application No. 62/144,293 filed on Apr. 7, 2015 and U.S.Provisional Application No. 62/151,174 filed on Apr. 22, 2015, theentire content of each application is herein incorporated by referencein its entirety.

FIELD OF THE DISCLOSURE

The present disclosure relates generally to networks, and moreparticularly, to the automated construction of virtual interfaces (VIFs)and structures of VIFs acting as hook points for multiple networktunnels. VIFs allow for the shifting of time and resource intensiveoperations such as routing upstream to the VIF which were typicallyapplied to tunnels.

BACKGROUND OF THE DISCLOSURE

Human beings are able to perceive delays of 200 ms or more as this istypically the average human reaction time to an event. If latency is toohigh, online systems such as thin-clients to cloud-based servers,customer relationship management (CRM), enterprise resource planning(ERP) and other systems will perform poorly and may even ceasefunctioning due to timeouts. High latency combined with high packet losscan make a connection unusable. Even if data gets through, at a certainpoint too much slowness results in a poor user experience (UX) and inthose instances the result can be refusal by users to accept thoseconditions in effect rendering poorly delivered services as useless.

To address some of these issues, various technologies have beendeveloped. One such technology is WAN optimization, typically involvinga hardware (HW) device at the edge of a local area network (LAN) whichbuilds a tunnel to another WAN optimization HW device at the edge ofanother LAN, forming a wide area network (WAN) between them. Thistechnology assumes a stable connection through which the two devicesconnect to each other. A WAN optimizer strives to compress and securethe data flow often resulting in a speed gain. The commercial driver forthe adoption of WAN optimization is to save on the volume of data sentin an effort to reduce the cost of data transmission. Disadvantages ofthis are that it is often point-to-point and can struggle when theconnection between the two devices is not good as there is little to nocontrol over the path of the flow of traffic through the Internetbetween them. To address this, users of WAN optimizers often opt to runtheir WAN over an MPLS or DDN line or other dedicated circuit resultingin an added expense and again usually entailing a rigid, fixedpoint-to-point connection.

Direct links such as MPLS, DDN, Dedicated Circuits or other types offixed point-to-point connection offer quality of connection and Qualityof Service (QoS) guarantees. They are expensive and often take asignificantly long time to install due to the need to physically drawlines from a POP at each side of the connection. The point-to-pointtopology works well when connecting from within one LAN to the resourcesof another LAN via this directly connected WAN. However, when thegateway (GW) to the general Internet is located at the LAN of one end,say at the corporate headquarters, then traffic from the remote LAN of asubsidiary country may be routed to the Internet through the GW. Aslowdown occurs as traffic flows through the internet back to servers inthe same country as the subsidiary. Traffic must then go from the LANthrough the WAN to the LAN where the GW is located and then through theInternet back to a server in the origin country, then back through theinternet to the GW, and then back down the dedicated line to the clientdevice within the LAN. In essence doubling or tripling (or worse) theglobal transit time of what should take a small fraction of globallatency to access this nearby site. To overcome this, alternativeconnectivity of another internet line with appropriate configurationchanges and added devices can offer local traffic to the internet, ateach end of such a system.

Another option for creating WAN links from one LAN to another LANinvolve the building of tunnels such as IPSec or other protocol tunnelsbetween two routers, firewalls, or equivalent edge devices. These areusually encrypted and can offer compression and other logic to try toimprove connectivity. There is little to no control over the routesbetween the two points as they rely on the policy of various middleplayers on the internet who carry their traffic over their network(s)and peer to other carriers and/or network operators. Firewalls androuters, switches and other devices from a number of equipment vendorsusually have tunneling options built into their firmware.

While last mile connectivity has vastly improved in recent years thereare still problems with long distance connectivity and throughput due toissues related to distance, protocol limitations, peering, interference,and other problems and threats. As such, there exists a need for securenetwork optimization services running over the top of standard internetconnections.

SUMMARY OF THE DISCLOSURE

Systems and methods for connecting devices via a virtual global networkare disclosed. In one embodiment the network system may comprise anendpoint device including a tunnel manager and a first virtualinterface, an access point server including at least one tunnel listenerand a second virtual interface. One or more communication paths ortunnels are formed connecting the tunnel managers and tunnel listeners.The virtual interfaces provide a logical point of access to the one ormore tunnels.

In one embodiment the communication paths include at least one tunnel inthe active state and one tunnel in the being built, standby, ordeprecated state.

In other embodiments tunnels in the standby state are periodicallytested to assess their viability and operational capability. Tunnels inthe standby state may be kept alive with at least one of pings or keepalive traffic. In other embodiments tunnels in the active state areperiodically tested to assess their viability and operationalcapability.

In some embodiments tunnels in the active state are transitioned to thedeprecated state and tunnels in the standby state are transitioned tothe active state. This transition may be based on periodic testing anddetermining that the quality of service (QoS) indicates that the tunnelin the standby state is the optimal tunnel and should be transitioned tobe the active tunnel.

In other embodiments multiple tunnels are in the active state. Duringperiods of low packet loss the active tunnels concurrently send uniquestreams of data between the endpoint device and the access point server.During periods of high packet loss the active tunnels concurrently sendduplicate streams of data between the endpoint device and the accesspoint server during periods of high packet loss.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to facilitate a fuller understanding of the present disclosure,reference is now made to the accompanying drawings, in which likeelements are referenced with like numerals or references. These drawingsshould not be construed as limiting the present disclosure, but areintended to be illustrative only.

FIG. 1 illustrates the packet bloat for IP transport packets whenheaders are added to the data at various layers.

FIG. 2 illustrates the packet bloat of data and headers at each of theseven layers of the OSI model.

FIG. 3 shows a block diagram depicting resolution of universal resourcelocator (URL) via lookup through internet domain name system (DNS) forrouting from Host (client) to the numeric IP address of the Host(server)

FIG. 4 illustrates an equation to calculate bandwidth delay product(BDP) for a connection segment or path taking into account variousconnectivity attributes.

FIG. 5 illustrates the traffic flow path within an end point device(EPD).

FIG. 6 illustrates an over the top (OTT) tunnel created on top of aregular internet connection.

FIG. 7 illustrates a virtual interface for over the top (OTT) tunnelscreated on top of a regular internet connection.

FIG. 8 is a flowchart describing how to determine the best egressingress point (EIP) for traffic to flow through a global virtual network(GVN) to the internet.

FIG. 9 illustrates the collaborative effort between various modules,mechanisms, technologies and other components of the GVN.

FIG. 10 illustrates layer one, layer 2, and layer 3 operations of aglobal virtual network (GVN).

FIG. 11 is a flowchart of Advanced Smart Routing (ASR) within a globalvirtual network (GVN).

FIG. 12 is a flow chart of the various routes available through a GVNfrom an origin to a destination.

FIG. 13 illustrates the conjoining of various different network segmentsinto an end-to-end path.

FIG. 14 illustrates a hop between two network segments.

FIG. 15 illustrates potential problems which can occur within a deviceat a hop between two network segments.

FIG. 16 illustrates the lifecycle of a tunnel.

FIG. 17 illustrates the relationship and interactions between an endpoint device (EPD), a central control server (SRV_CNTRL), and an accesspoint server (SRV_AP) when building a tunnel between the EPD and theSRV.

FIG. 18 illustrates the logical organization of interfaces and virtualinterfaces within an end point device (EPD) to support multiple tunnels.

FIG. 19 is flowchart that describes the logic of algorithms which poweradvanced smart routing (ASR) within a global virtual network (GVN).

FIG. 20 illustrates the functionality of a virtual interface VIF with atraffic path and the advantages which it offers.

FIG. 21 is a flowchart describing the algorithm governing when the flowof traffic should be switched from one tunnel to another tunnel.

FIG. 22 illustrates the logical structure of two virtual interfaces(VIF) connected sequentially along a path.

FIG. 23 illustrates that time required for various tunnel (TUN) andvirtual interface (VIF) processes.

FIG. 24 illustrates the logical structure of multiple VIFs arrangedsequentially within a traffic path between traffic in and other traffic.

FIG. 25 illustrates the logical structure of three virtual interfacesand their various tunnels to three different regions.

FIG. 26 illustrates timelines for various tunnel (TUN) and virtualinterface (VIF) related operations.

FIG. 27 is a flowchart that describes the algorithm governing thedecision making process of whether or not to switch from one virtualinterface to another virtual interface.

FIG. 28 illustrates the logical structure of three virtual interfacesand their various tunnels to three different regions.

FIG. 29 is a flowchart that describes the algorithm governing theorderly destruction of a virtual interface (VIF).

FIG. 30 illustrates how an encrypted tunnel protects data.

FIG. 31 illustrates the security afforded by one tunnel wrapped inanother tunnel.

FIG. 32 illustrates wrapped and capped tunnel.

FIG. 33 illustrates an 8-bit byte scrambler on two gateway devices.

FIG. 34 illustrates three different scramble phases for bit-scrambledbytes of a CAP.

FIG. 35 illustrates an internal tunnel through a series of wrappings andthen a CAP.

FIG. 36 illustrates firewall-to-firewall tunnel traffic during a tunnelfailover.

FIG. 37 illustrates firewall-to-firewall tunnel traffic during a tunnelfailover.

FIG. 38 illustrates firewall-to-firewall tunnel traffic during a tunnelfailover.

FIG. 39 illustrates the linking of two or more local area networks(LANs) into a wide area network (WAN).

FIG. 40 illustrates the importance of a server availability list and howIP addresses and ranges are assigned for various devices.

FIG. 41 illustrates multiple parallel unique streams between devices.

FIG. 42 illustrates multiple parallel non-unique streams betweendevices.

FIG. 43 illustrates the logical framework and algorithmic structure forstormy weather mode (SWM)

FIG. 44 illustrates multiple tunnels between devices within a globalvirtual network (GVN) across multiple regions.

FIG. 45 illustrates potential problems with bottlenecks through a hopbetween two network segments.

FIG. 46 illustrates the organizing and reporting of information on theSRV_CNTRL.

FIG. 47 is a flowchart that describes the logic used for tunnel tests.

FIG. 48 illustrates the running of parallel tunnel tests to measurelatency, bandwidth, packet loss, and other factors.

FIG. 49 illustrates running connectivity tests without interfering withcurrent user tunnel usage.

FIG. 50 illustrates interaction between three devices which collaboratein the process of tunnel building.

FIG. 51 illustrates the relationships between various database tablesused to store connectivity information.

FIG. 52 illustrates the requirement for unique information per tunnel toavoid collisions.

FIG. 53 is a flowchart illustrating the logical flow used to assign aport to an IP address used to build a tunnel.

FIG. 54 is a flowchart describing a structure for a series of tests ofvarious ports of an IP address.

FIG. 55 is a flowchart that show the logic regarding the management ofpeer pair relationships between devices.

FIG. 56 illustrates the steps used set up and then run tunnel tests.

FIG. 57 illustrates a virtual end point (VEP) extended into the cloud.

FIG. 58 illustrates the binding of a domain name to a dynamic virtualend point (VEP).

FIG. 59 illustrates the routing of traffic for a domain.gTLD to enter aglobal virtual network (GVN) via the most optimal egress ingress point(EIP).

FIG. 60 illustrates a registry of end point devices (EPD) and personalend point devices (PEPD) which can be located and reached via adomain.gTLD.

FIG. 61 illustrates devices which may be reachable via a subdomain of aglobal top level domain.

FIG. 62 illustrates a method for utilizing a graphic user interface(GUI) running in a browser on a Client Device to manage virtual endpoint information.

FIG. 63 illustrates how subdomains.domains.gTLD routing can takeadvantage of advanced smart routing (ASR) in a global virtual network(GVN).

FIG. 64 shows a block diagram of technology used by and enabled by aglobal virtual network (GVN)

FIG. 65 illustrates some system modules and components for an end pointdevice EPD, central control server SRV_CNTRL, and an access point serverSRV_AP.

FIG. 66 illustrates some system modules and components for an end pointdevice EPD, central control server SRV_CNTRL, and an access point serverSRV_AP.

FIG. 67 illustrates some system modules and components for an end pointdevice EPD, central control server SRV_CNTRL, and an access point serverSRV_AP.

DETAILED DESCRIPTION

A GVN offers secure network optimization services to clients over thetop of their standard internet connection. This is an overview of theconstituent parts of a GVN as well as a description of relatedtechnologies which can serve as GVN elements. GVN elements may operateindependently or within the ecosystem of a GVN such as utilizing the GVNframework for their own purposes, or can be deployed to enhance theperformance and efficiency of a GVN. This overview also describes howother technologies can benefit from a GVN either as a stand-alonedeployment using some or all components of a GVN, or which could berapidly deployed as an independent mechanism on top of an existing GVN,utilizing its benefits.

A software (SW) based virtual private network (VPN) offers privacy via atunnel between a client device and a VPN server. These have an advantageof encryption and in some cases also compression. But here again thereis little to no control over how traffic flows between VPN client andVPN server as well as between the VPN server and host server, hostclient or other devices at destination. These are often point-to-pointconnections that require client software to be installed per deviceusing the VPN and some technical proficiency to maintain the connectionfor each device. If a VPN server egress point is in close proximity viaquality communication path to destination host server or host clientthen performance will be good. If not, then there will be noticeabledrags on performance and dissatisfaction from a usability perspective.It is often a requirement for a VPN user to have to disconnect from oneVPN server and reconnect to another VPN server to have quality or localaccess to content from one region versus the content from anotherregion.

A Global Virtual Network (GVN) is a type of computer network over thetop (OTT) of the internet providing global secure network optimizationservices utilizing a mesh of devices distributed around the worldsecurely linked to each other by advanced tunnels, collaborating andcommunicating via Application Program Interface (API), Database (DB)replication, and other methods. Traffic routing in the GVN is always viabest communication path governed by Advanced Smart Routing (ASR) poweredby automated systems which combine builders, managers, testers,algorithmic analysis and other methodologies to adapt to changingconditions and learning over time to configure and reconfigure thesystem.

The GVN offers a service to provide secure, reliable, fast, stable,precise and focused concurrent connectivity over the top (OTT) of one ormore regular Internet connections. These benefits are achieved throughcompression of data flow transiting multiple connections of wrapped,disguised and encrypted tunnels between the EPD and access point servers(SRV_AP) in close proximity to the EPD. The quality of connectionbetween EPD and SRV_AP's is constantly being monitored.

A GVN is a combination of a hardware (HW) End Point Device (EPD) withinstalled software (SW), databases (DB) and other automated modules ofthe GVN system such as Neutral Application Programming InterfaceMechanism (NAPIM), back channel manager, tunnel manager, and morefeatures which connect the EPD to distributed infrastructure devicessuch as access point server (SRV_AP) and central server (SRV_CNTRL)within the GVN.

Algorithms continually analyze current network state while taking intoaccount trailing trends plus long term historical performance todetermine best route for traffic to take and which is the best SRV_AP orseries of SRV_AP servers to push traffic through. Configuration,communication path and other changes are made automatically and on thefly with minimal or no user interaction or intervention required.

Advanced Smart Routing in an EPD and in an SRV_AP ensure that trafficflows via the most ideal path from origin to destination through an assimple as possible “Third Layer” of the GVN. This third layer is seen byclient devices connected to the GVN as a normal internet path but with alower number of hops, better security and in most cases lower latencythan traffic flowing through the regular internet to the samedestination. Logic and automation operate at the “second layer” of theGVN where the software of the GVN automatically monitors and controlsthe underlying routing and construct of virtual interfaces (VIF),multiple tunnels and binding of communication paths. The third andsecond layers of the GVN exist on top of the operational “first layer”of the GVN which interacts with the devices of the underlying Internetnetwork.

The cloud from a technical and networking perspective refers to devicesor groups or arrays or clusters of devices which are connected and areavailable to other devices through the open internet. The physicallocation of these devices is not of significant importance as they oftenhave their data replicated across multiple locations with deliveryto/from closest server to/from requesting client utilizing contentdelivery network (CDN) or other such technology to speed connectivitywhich enhances user experience (UX).

In addition to the broader theme of addressing quality of service (QoS)issues related to the network connectivity which improve generalperformance and enhance user experience, two other main features arethat a GVN allows for the extension of a network edge into the cloud.Additionally, the EPD acts as a bridge between the broader network and alocal area network (LAN) bringing elements of the cloud as a local nodeextension into the edge of the LAN. The GVN also allows for theautomated construction of virtual interfaces (VIFs) and structures ofVIFs acting as hook points for multiple tunnels. These VIFs allow forthe shifting of time- and resource-intensive operations such as routingupstream to the VIF which were typically applied to tunnels.

FIG. 1 illustrates the packet bloat for IP transport packets whenheaders are added to the data at various layers. At the ApplicationLayer 1-L04, the data payload has an initial size as indicated by Data1-D4. The size of the packet is indicated by Packet Size 1-PBytes. Atthe next layer, Transport Layer 1-L03, the Packet Size 1-PBytes has theoriginal size of the data 1-D4 which is equal to Data UDP 1-D3. Itfurther includes bloat of Header UDP 1-H3. At the next layer, InternetLayer 1-L02 the body payload Data IP 1-D2 is a combination of 1-D3 and1-H3. It increases 1-PBytes by Header IP 1-H2. At the Link Layer 1-L01,Frame Data 1-D1 is a combination of 1-H2 and 1-D2. It further increases1-PBytes by Header Frame 1-H1 and Footer Frame 1-F1.

FIG. 2 illustrates the packet bloat of data and headers at each of theseven layers of the OSI model. The original data 2-D0 grows at eachlevel Application OSI Layer 7 2-L7 with the addition of headers such asHeader 2-H7. At each subsequent layer down from layer 7 to layer 1, thedata layer is a combination of the previous upper level's layer of Dataand Header combined. The total packet bloat in an OSI model at thePhysical OSI Layer 2-L1 is denoted by Packet Size 2-PBytes.

FIG. 3 shows a block diagram depicting resolution of universal resourcelocator (URL) via lookup through internet domain name system (DNS) forrouting from Host (client) to the numeric IP address of the Host(server). A content request or push from host client (C) 101 to hostserver (S) 301 as files or streams or blocks of data flows in thedirection of arrow 001. The response 002 of content delivery from host Sto host C as files or streams or blocks of data. The host client device101 in Client-Server (C-S) relationship makes a request to accesscontent from a remote host S or sends data to remote host S via auniversal resource locator (URL) or other network reachable address.

The connection from the host client to the internet is marked asP01—connection from client 101 to POP 102 directly facing or can belocated in a local area network (LAN) which then connects to theinternet via a point of presence (POP) can be referred to as the lastmile connection. The point of presence (POP) 102 which representsconnection provided from an end point by an internet service provider(ISP) to the internet via their network and its interconnects. If theURL is a domain name rather than a numeric address, then this URL issent to domain name system (DNS) server 103 where the domain name istranslated to an IPv4 or IPv6 or other address for routing purposes.

Traffic from client 101 to server 301 is routed through the Internet 120representing transit between POPs (102 and 302) including peering,backhaul, or other transit of network boundaries.

The connection P02 from POP 102 to DNS 103 to look up a number addressfrom a universal resource locator (URL) to get the IPv4 address or othernumeric address of target server can be directly accessed from the POP102, or via the Internet 120. The connection P03 from POP 102 of an ISPto the Internet 120 can be single-honed or multi-honed. There is aconnection P04 from the Internet 120 to the ISP's or internet datacenter's (IDC) internet-facing POP 302. The connection P05 from the POP302 of the server to the host 301 can be direct or via multiple hops.

The lookups from name to numeric address via domain name systems is astandard on the Internet today and assumes that the DNS server isintegral and that its results are current and can be trusted.

FIG. 4 illustrates an equation to calculate bandwidth delay product(BDP) for a connection segment or path taking into account variousconnectivity attributes. The further the distance between the two pointsand/or other factors which increase latency impact the amount of datathat the line can blindly absorb before the sending device receives amessage back from the recipient device about whether or not they wereable to accept the volume of data.

In short, the BDP calculation can represent a measure of how much datacan fill a pipe before the server knows it is sending too much at toofast a rate.

The Bandwidth 4-000 can be measured in megabits per second (Mbps) andGranularity 4-002 can be unit of time relative to one second. Toaccurately reflect BDP, the Bytes 4-020 are divided by the number ofBits 4-022 of a system. Latency 4-050 is a measurement of round triptime (RTT) in milliseconds (ms) between the two points.

So for example, BDP of the following network path with theseattributes—Bandwidth 4-000 of 10 GigE using Granularity 4-022 of onesecond, on an eight bit system over a path with Latency 4-050 of 220ms—can be calculated as follows:

${\frac{{10,000}{,000,000}}{1}*\frac{1}{8}*0.220} = {275,000,000\mspace{14mu}{bits}\mspace{14mu}{OR}\mspace{14mu} 33,569.3\mspace{14mu}{MB}}$

Therefore on a 10 GigE line, the sending device could theoretically send33,569.3 megabytes of information (MB) in the 220 ms before a messagecan be received back from the recipient client device.

This calculation can also be the basis of other algorithms such as oneto govern the size of a RAM buffer, or one to govern the time and amountof data that is buffered before there is a realization of a problem suchas an attack vector. The throttling down by host server could lead tounderutilized pipes but the accepting of too much data can also lead toother issues. The calculation of BDP and proactive management approachto issues leads to efficient utilization of hardware and networkresources.

FIG. 5 illustrates the traffic flow path within an end point device(EPD). The traffic flows between the LAN 5-000 and the end point device(EPD) 5-100 over connection 5-CP00. End point device (EPD) 5-100 flowsto the point of presence (POP) 5-010 over connection 5-CP06. The pointof presence (POP) 5-010 is connected to the Internet 5-020 viaconnection 5-CP08.

FIG. 6 illustrates an over the top (OTT) tunnel created on top of aregular internet connection. FIG. 6 is similar to FIG. 5 andadditionally shows an access point server (SRV_AP) 6-300. The accesspoint server (SRV_AP) 6-300 includes a tunnel listener TNL0 6-380. Theend point device (EPD) 5-100 includes a tunnel manager TMN0 6-180. Atunnel TUN0 6-CP80 is constructed that connects the tunnel manager TMN06-180 and the tunnel listener TNL0 6-380. The tunnel is constructedover-the-top (OTT) of the regular internet connection 6-CP06 and 6-CP08.

FIG. 7 illustrates a virtual interface for over the top (OTT) tunnelscreated on top of a regular internet connection. FIG. 7 is similar toFIG. 6 and additionally includes a virtual interface (VIF) as a hookpoint on each device EPD 7-100 and SRV_AP 7-300 for multiple tunnels tobe built between two. This figure also shows multiple tunnels 7-CP80,7-CP82, and 7-CP84 between EPD 7-100 and SRV_AP 7-300. A main advantageof the virtual interface VIF0 7-170 and VIF0 7-370 on each devicerespectively is that this approach enables clean structural attributesand a logical pathway for more complex constructs of tunnels andsubsequent routing complexity.

Certain other advantages with regards to timing and flow control will bedescribed in subsequent figures below.

FIG. 8 is a flowchart describing how to determine the best egressingress point (EIP) for traffic to flow through a global virtual network(GVN) to the internet. Some example routes from a source (SRC) to adestination (DST) through the GVN are shown in Table 1.

TABLE 1 Example routes through a GVN RT_ID Path from Origin toDestination Rating 1 Source  

 EPD 

   

 POP 

  0.15 Internet 

 destination 2 Source  

 EPD 

 TUN1 

  0.36 SRV_AP1  

   

 POP 

 Internet 

  Destination 3 Source  

 EPD 

 TUN2 

  0.58 SRV_AP2  

   

 POP 

 Internet 

  Destination 4 Source  

 EPD 

 TUN2 

 SRV_AP2  

  0.96 SRV_AP3 

   

 POP 

  Internet 

  Destination 5 Source  

 EPD 

 TUN3 

  SRV_AP2 

  0.85 WAN 

 SRV_AP4 

   

 POP 

  Internet 

  Destination

EPD

and SRV_AP2

denote Egress/Ingress Points (EIP) from a device to/from the internet.The two sided arrow

symbol indicates the routed path between two devices. This can either bedirectly through the internet, as a network segment OTT the internet asa tunnel or other mechanism (possibly as part of a GVN) or via othernetwork path between devices. The point of origin is on the left and thedestination implies the final location where the traffic is to be routedto/from. Paths through the GVN could be structured as amulti-dimensional array or other data pattern to denote the end-to-endpath for traffic to take within the GVN.

The rating is a calculated value for a route based on a number offactors. A rating of 0.00 implies an impossible route. A rate of 1.00implies the most perfect route with highest bandwidth at wire-line speedlatency. RT_ID is the route ID number to differential one route fromanother both for utility, testing and logging purposes. This is utilizedto determine the quality of various routes through the GVN. RT_ID is anidentification for a specific route from a list of routes. The qualityof service (QoS) for each route can include evaluating security,latency, packet loss, jitter, bandwidth, and other factors.

The evaluation of various measures should take into account the totalpath:Total Path=GVN to Egress+Egress to destinationWhile evaluating total path, priority weighting in favor of the GVN overthe open internet takes into account the security and optimization ofthe GVN to supersede certain measures.

FIG. 9 illustrates the collaborative effort between various modules,mechanisms, technologies and other components of the GVN.

There are three layers of the GVN—layer one is the physical networklayer such as the internet on which the GVN is built over the top (OTT)of. Layer three is the GVN network layer that client devices see as apartial or complete path to destination. Layer two is the logic layerbetween the two.

There are components which interact with the physical conditions 9-00.Dynamic construct modules at 9-20 strive to maintain connectivity of theGVN. The joint effort section described herein links the relevantmodules of the GVN to physical 9-00 and dynamic 9-20 elements. Forexample, in order for the advanced smart routing (ASR) module G106 toproperly function, there must be multiple access point servers (SRV_AP)GP106 placed at various locations, with adequate routing and peeringGR106. In order for an EPD to be able to select the most appropriateSRV_AP to establish a connection with, it needs information about whichSRV_AP's are best. The ASR server availability module SA106 ranksservers for that specific EPD based on information provided by ASR testmanager TM106 and when an EPD requires a new tunnel to be established,it utilizes the server availability list SA106 in order to build a newtunnel. Tests are then run on that tunnel via TM106.

As another example, for NAPIM G102 to operate it needs API listeners andhandlers HL102 on a host server. On both host client and host server inthe NAPIM, an operations manager OM102 is running to handle thepreparation, then sending, handling, processing of API requests andresponses. The dynamic construct of the NAPIM entails peer managementPM102, management of related NAPIM actions AM102, and the transactionsat physical TP102 and dynamic TM102.

FIG. 10 illustrates layer 1, layer 2, and layer 3 operations of a globalvirtual network (GVN) and compares the network at the base level viapaths P01 through P13 to the network through the GVN T01 through T03.

Significant measurements at the base internet level CTN140 are LAN toGVN via EPD 10-100 to SRV_AP 10-300 for which connectivity metrics forbandwidth BW, latency Δt=A ms, Packet Loss, and other factors areevaluated. At the other end of the connection, similar measurements BW,Δt=C ms, Packet Loss and other factors at CTN142 measure the on-rampingof traffic into the GVN from EPD 10-102. Through the GVN between SRV_AP10-300 and SRV_AP 10-302 for the GVN trans-regional OTT various internetsegments CTN340 measure BW, Δt=B ms, Packet Loss, and other factors areevaluated. Overall path latency through the GVN Layer Three GVN10-3 canbe calculated as the sum of the latencies of A+B+C for total inmilliseconds.

At GVN Layer Three GVN10-3, ASR and other features govern how and wheretraffic flows through the GVN. This entails determining the best tunnelto send traffic through based on target region and traffic type, QoS ofthe segments through the GVN and other factors.

At GVN Layer One GVN10-1, the physical conditions of the base networkconnectivity are monitored and tested to determine best route options ontop of which to build GVN tunnels and pathways through them. GVNpathways can transit through joined tunnels passing through SRV_AP,SRV_BBX and other GVN hardware devices. This can also determine whichtunnels to make, to continue using and which to deprecate.

Mechanisms, modules and component parts at GVN Layer Two GVN10-2 help toset up, test, manage and otherwise operate the plumbing between LayerThree GVN10-3 and GVN Layer One GVN10-1. Tunnel testing can be done inLayer Three at the EPD 10-100 and at the SRV_AP 10-300 via its tunneltester 10-312.

FIG. 11 is a flowchart of Advanced Smart Routing (ASR) within a GlobalVirtual Network (GVN). From the starting point of a host client 101device in a local area network (LAN) 102 connected to an end pointdevice (EPD) 103, the GVN offers the EPD a multitude of connection pathsto multiple potential termination points. This is flowchart is a highlevel view of the routing logic a packet could take as it transits a GVNutilizing ASR for optimal performance. From the perspective of the hostclient 101, their traffic will flow through an internet protocol (IP)network with as few number of hops and best possible latency at thethird layer of the GVN. The first layer of the GVN is the base internetwith automatic configuration of a construct of virtual interfaces,tunnels, routing and other networking policies. The second layer of theGVN is where the algorithms, software and logic to govern operationbetween layer three and layer one.

The first main routing decision is at a logic gate 104 within the EPODwhere traffic either egresses to the local Internet 107 where the EPD islocated via path P104 or if it is to go through a secure wrapped andobfuscated tunnel via P107 to the access point server (SRV_AP) 110offering the best connectivity to the region where SRV_AP 110 islocated. Prior to traffic egressing SRV_AP 110, it passes through arouting logic gate 111. Traffic to egress locally to the internet 113will go via path P111 to either a host client 115 or a host server 116there. If traffic is not local but rather to be relayed to anotherregion, it will go via path P116 through a tunnel 118 to the next SRV_AP119.

At SRV_AP 119, three of many possible routing options are illustrated bythe paths that traffic can take. There is a logic gate 126 to determineif traffic should remain and egress to the local internet 129 or if itshould go through a tunnel via P126 to a SRV_AP in another region 127.Another possibility is illustrated via path P119 which demonstrates atunnel from SRV_AP 119 to another EPD 121 in a distant region. This isan EPD 103 to EPD 121 bridged via multiple bridged tunnels. A furtherpossibility is for traffic to reach client devices 125 126 in the LAN122 where EPD 121 is located through the EPD's connection P121.

FIG. 12 is a flow chart of the various routes available through a GVNfrom an origin C 12-002 to destination S 12-502. There can be many morepossible combinations that are not shown or discussed.

Path 12-CP00 from the Origin A Client C 12-002 to the EPD 12-108 can beused to measure the performance from the client through the LAN to theEPD. Matching of best routes is achieved after tests and evaluatingreal-time data of available paths. GVN ingress from EPD via first hop12-CP00 to an access point server (SRV_AP) 12-102, 12-104, 12-106,12-202, 12-204.

Paths from EPD to first SRV_AP can be defined as the ingress point fromthe EPD into the GVN and measured accordingly. Internal hops from SRV_APto SRV_AP follow internal routes which always try to maintain the bestpath connectivity. These could be OTT internet, over backbone, over darkfiber, or other related routing.

Best egress points out of the GVN are also kept track of locally, inthat remote region and also holistically for the entire network segmentfrom origin to destination.

Tests can be run on each segment, combinations of segments, and thetotal network path from end to end taking into account various factorsto evaluate. Traffic type and path determination can be depending ondata attributes and profile QoS requirements. The main path choice isalways based on best factors for traffic over path. A function of thismechanism is to match paths between destination and origin to flow forbest possible bidirectional route. Traffic for target destination flowsvia the most ideal egress ingress point (EIP) for that specificdestination.

Various database tables can be maintained to support and govern routemanagement in the advanced smart routing mechanism:

-   -   A “IP Addresses in this region” table is a registry of IP        addresses to keep local and egress into the local internet        12-122 via EIP local 12-120.    -   A “Geo-D targets and various EIPs” table plots a path through        the GVN to the most appropriate EIP 12-320 12-322 12-324 12-326        12-328 in a remote region to reach destinations 12-512 12-522        12-532 via internet in remote regions 12-510 12-520 12-530.    -   A “Country IP Blocks for regional routing” table can be utilized        for routing based on IP addresses in various regions and/or        countries or other location granularity.    -   A “Server_Availability List” can be is compiled for each device        via algorithmic analysis of various factors including best        servers for that device to utilize as well as on the current        state and condition of the various potential servers that it        could utilize. Load factors related to capacity, routing,        network segment conditions, and other issues which could impact        operations are taken into account when allocating servers and        listing them on a server availability list created for a        specific device.    -   A “Tunnel Registry” table can be used to keep track of the        multiple tunnels between peer pairs.    -   A “GVN routes” can be used to list the routing for available        end-to-end or partial paths for traffic to take via the GVN from        one point to another point.

The above information is described as being stored in database tables asone example of storage to assist in this description. It could also bestored as lists in flat files, in memory or on disk, or in various otherformats. Some or all of the routing information can be utilized todetermine best route for traffic to take by matching destination to EIPvia the best path.

FIG. 13 illustrates the conjoining of various different network segmentsinto an end-to-end path. For example from Client 13-000 to Server13-300, the traffic transits via a local area network (LAN) 13-010 to anend point device (EPD) 13-100 to an internet service provider's (ISP)13-200 network to a backbone 13-220 to internet 13-250 in a remoteregion to an internet data center's (IDC) point of presence (POP) 13-320into the IDC's internal network 13-310 and then to the server 13-200.

As shown by this example, it is important to understand thecharacteristics of each segment and how that segment impacts the trafficflow with respect to the complete end-to-end pathway. An internalnetwork or LAN 13-N100 will typically have a reasonable amount ofbandwidth (BW) for internal use such as BW 13-B100 which is 10 GigE insize. The bandwidth for an ISP's network 13-N202 will also typically befairly large as exemplified by BW 13-B202 of 40 GigE. Between those twonetworks, a last mile connection 13-N200 between the client location andthe ISP is a relatively small 13-B200 BW of 100 Mbps. There are numerousdrivers behind this but the main one is cost. An ISP will bring a pipeto a neighborhood of a bandwidth of a certain size and then will usuallyshare this amount with many different users to each of their last mileconnections. These upstream paths are the beginning segments towards thebroader and wider general internet.

A backbone 13-N220 connects ISPs to each other, regions to regions, andmore and backbones offer very deep and high bandwidth connectivity suchas 13-B220 of 100 GigE. This could represent the carrying capacity of astrand of fiber between two points, and/or the size of the switch'scapacity rating or other factors.

The internet 13-N250 in this figure is represented by dual pipes of BW13-B250 and 13-B252 each at 40 GigE. This is an example of a multi-honedconnectivity in an internet. There may be many other large pipes at thecore of an internet connected together.

ISP peering 13-N320 between the internet 13-N250 and an IDC network13-N310 is represented again by multi-honed connectivity BW of 10 GigEeach for 13-B320, 13-B322, and 13-B328. This represents dedicated lastmile for that data center. There may be many more communication linksfor an IDC.

The internal IDC network 13-N310 will typically have very high BW13-B310 distributed amongst various internal networks which each israted to a certain speed such as 100 GigE. The notation 2*100 GigErepresents that this is a network two times 100 GigE BW.

FIG. 14 illustrates a hop between two network segments. The hop 14-H020through Device B 14-020 is a connection between two network segments14-1020 and 14-2030 which are paths to Device A 14-010 and Device C14-030 respectively.

There are several factors which influence the flow of traffic through ahop including the bandwidth of the two network segments, the physicalcapacity for carrying traffic through Device B 14-020, the current levelof traffic flowing through it and corresponding congestion, and otherfactors.

FIG. 15 illustrates potential problems which can occur within a device15-020 at a hop between two network segments P1020 and P2030. A problem15-Problem 400 such as routing issues 15-PR400 may add too many hops toa path, and/or increase latency due to a circuitous path. There areother routing problems 15-Problem406 such as a dead end at later hop15-PR406 which can influence which segment that traffic should flow downif there is a choice after a hop.

Another problem 15-Problem 402 such as filtering 15-PR402 on the Device15-020 could significantly slow down the traffic transiting through thehop 15-H020. Some kinds of filtering may block a traffic type entirelyor firewall operations such as deep packet inspection (DPI) require timeand resources adding to the latency through a hop.

Congestion related 15-PR404 problems 15-Problem404 have to do with thevolume of traffic as measured by bandwidth or could also be related tothe problem of too many concurrent connections established by variousstreams of data through the hop 15-H020, a combination of both, and/orother factors.

Other problem 15-Problem408 issues such as device malfunction 15-PR408can cause unpredictable and detrimental drags on traffic through the hop15-H020.

Problems 15-Problem410 such as BDP related issues 15-PR410 occur whenone segment is larger than another segment. If inbound traffic from thelarger segment enters Device 15-020 the smaller segment cannot acceptthe entirety of the volume. The device may try buffering the excesstraffic in RAM to be sent when the data flow abates. If the RAM or otherbuffer completely fills up, the result will be packet loss.

There can also be other problems 15-Problem412 which have a directimpact on the efficiency of traffic flow through a hop, however thesemay be unknown problems 15-PR412 and as such the only viable remedy maybe to route traffic around that hop.

Other problems may be possible and occur through a hop. The key point isthat the result of problems through a hop are high latency, packet loss,constricted bandwidth and other effects which adversely affect trafficflow. A follow-on consequence of packet loss through a hop is theperverse result of sending devices resending dropped packets which cancause a cascading effect due to even more packets trying to get throughan already oversaturated hop.

FIG. 16 illustrates the lifecycle of a tunnel between an initiatingclient device and a listening server device to build a tunnel betweenthe two. The terms client and server are used for descriptive purposesand may reflect the roles of the devices described or devices may existwithin a peer to peer (p2p) relationship with one peer behaving like aclient and the other peer behaving like a server.

The tunnel establishment process 16-000 steps from Tunnel State: Down16-200 through to Tunnel State: Up 16-202. It begins with the first stepBegin Tunnel Build 16-100. Prepare Tunnel Info 16-102 begins with theclient device gathering information about the server to which it desiresto build a tunnel with. If a peer pair relationship exists, and if theinformation is current, then the client device will use thatinformation. If there does not exist a peer pair relationship, or ifthere is no tunnel information which could be used by the devices tobuild a tunnel between them, or if the peer pair relationship info ortunnel info are stale, then an API call to a SRV_CNTRL (e.g. SRV_CNTRL17-200 in FIG. 17) can be utilized by each device to gather relevantpeer pair and tunnel information.

The next step, Secure hand shake C with S 16-104, is initiated by theclient with call to the server. The initial server check may validate afinger print and identifiers of client may verify that it is entitled tointeract with the server. A TLS handshake may be used for each device totell the other who it is and to exchange keys with which to use tocreate an encrypted connection between them so that they can talk witheach other. During regular tunnel establishment, there is risk that thetunnel can be sniffed and interfered with such as by the deliberateinjecting of a TCP_RST reset packet sent to break the flow of trafficbetween the two tunnel peers.

The next step, Info Exchange C⇄S 16-106, includes information specificto the building of the tunnel, including credentials, keys, networkparameters, configuration settings, and other information. The settingsbetween both sides must match or there may be problems with tunnelbuilding.

The next step, Construct tunnel+encrypt 16-108, will use the informationabout the tunnel to construct the encrypted tunnel and to prepare it tosend traffic. The traffic begins to flow here.

The next step, Apply routing+hook 16-110, is where routes are applied tothe tunnel determining which traffic should go through the traffic andwhich traffic should stay within the client device to be handled by thenext internal interface there.

The next step, Apply on-Up actions 16-112, can include on up triggers toexecute scripts, subroutines, or other actions to log tunnel up event ina database, to check routes, and do other housekeeping such as testing,applying routes, and if IP forwarding is required to automatically setthat up, or to take other actions.

At a certain point after the tunnel is constructed at the step Constructtunnel+encrypt 16-108, the tunnel is ready and able to carry traffic.

Depending on the size and complexity of the routing table applied at theApply routing+hook 16-110 step, a relatively significant amount of timemay pass between the start and finish of the route building.

Since traffic may already be flowing through the tunnel during routebuilding, an unpredictable, systemic behavior effecting traffic flow mayoccur. Some traffic may go through the tunnel while other traffic maynot go through. Leakage is therefore an unintended consequence of thisperiod of time during route building leading to potential securityissues, potential for lost packets in a stream, as well as other issues.For example the reciprocal host device in a stream may get confused onwhere to send the traffic back to since the start of the stream wasflowing from an edge IP address on the first device which is suddenlychanged to the IP address on edge of the server device once the tunnelis up.

When a tunnel goes down, it suddenly drops sending all traffic out ofthe tunnel and inboard tunnel traffic cannot find the end point of thetunnel which no longer exists and new tunnel build process has to waitfor cleanup of routes and for the tunnel destruction process 16-040 ofthe first tunnel to complete. Furthermore, the end result is an issue ofgaps in the protections afforded by the tunnel as well as unstablerouting leading to broken connections. The new tunnel needs time tobuild before it can be ready to carry traffic dependably.

The Tunnel Destruction Process 16-040 describes the steps in order fromTunnel State: Up 16-202 back to Tunnel State: Down 16-200. The causesfor a tunnel to break may be an intentional clean stop order or anunintentional non-clean stop due to a broken underlying connection, apoor connection with too high latency or too much packet loss, or ifthere are not enough system resources to maintain the tunnel, or otherreason(s).

The Apply on-Down actions 16-142 step execute scripts such as capturingtemp log files and saving their data in database tables, in log files,or other forms of permanent storage. An entry into a database log cannote the tunnel down event. This step can also communicate via API withASR managers and tunnel managers to notify state change of the tunnel.Each device can take actions independently or in collaboration withother devices according to need.

The next step, Apply routing changes 16-144, removes routes from thetunnel as well as removal of the tunnel's entrance and exit routeentries. Until routes are flushed, then traffic can be effectivelyblocked as if the tunnel is no longer up but traffic routed to it, thenthere is nowhere for the traffic to go. Once routes are removed, trafficcan flow around the old tunnel.

The orderly break down 16-146 and free up resources 16-148 stepscomplete the removal of the tunnel.

FIG. 17 illustrates the the relationship and interactions between, anend point device (EPD) 17-100, a central control server (SRV_CNTRL)17-200, and an access point server (SRV_AP) 17-300 when building of atunnel TUN0 17-CP80 between the EPD 17-100 and SRV_AP 17-300.

The steps to build TUN0 17-CP80 include 17-S1 Handshake, 17-S2 InfoExchange, and 17-S3 Tunnel Build. In order for the Tunnel Manager(Builder) 17-D110 on EPD 17-100 to build the TUN0 17-CP80, it needscertain information about the SRV_AP 17-300 which it can connect with tobuild the tunnel, information about the tunnel, and more. In order forthe Tunnel Manager (Listener) 17-D310 on SRV_AP 17-300 to accept thehandshake 17-S1 from EPD 17-100's Tunnel Manager (Builder) 17-D110, tonegotiate information exchange 17-S2, and then to build the tunnel17-S3, it also requires similar information. For example, the port andIP address assignment on SRV_AP 17-300 should be unique to preventconflicts. In addition, certificates, credentials such as password, andsupporting information for advanced tunnel features such as wrappingand/or capping also need to be known by both peers when building atunnel.

For non-stable, dynamically changing information used for tunnelbuilding, a client device such as an end point device (EPD) 17-100 willneed to share info with a server such as an access point server (SRV_AP)17-300 prior to the Tunnel Manager (Builder) 17-D110 being able tointeract with the Tunnel Manager (Listener) 17-D310 on an SRV_AP 17-300.

Tunnel security involves not just the aspects and attributes of theactual tunnel while up but also covers various stages during a tunnellife cycle. There exists a need to share and to protect keys,credentials, configuration, and other settings. By each devicecollaborating with an SRV_CNTRL 17-200 to share information pertinent tothe other, this can protect the sending, generation, publishing,updating, and more handling of the information. Handshake and keyexchange can be protected via encryption and also via cappedconnections. While up, the tunnel may be protected by encryption andalso obfuscation via a cap.

FIG. 18 illustrates the logical organization of interfaces and virtualinterfaces within an end point device (EPD) 18-100 to support multipletunnels. The interfaces ETH0 18-102, ETH1 18-016, and ETH2 18-108 aredirectly bound to the physical network interface cards (NIC) of the EPD18-100. In this example, ETH0 18-102 is connected to a last mile uplinkconnection to the local internet 18-010 via paths 18-P400 to the ISP'sPOP 18-400 and 18-P010 to the internet.

FIG. 19 is flowchart that describes the logic of algorithms which poweradvanced smart routing (ASR) within a global virtual network (GVN). Thefirst process is to Identify target region 19-100 with its correspondingsub-processes identify region 19-110 and identify potential EIPs to use19-120. This sets up the subsequent processes to hone in on the targetegress ingress point (EIP) to utilize.

The next process, Plot route options (ASR) 19-200, utilizes subprocesses server availability list 19-210 and routes list ranked 19-220to determine the most optimal server(s) with which to build tunnels ifthey do not exist.

The next process, Examine network segments 19-300, utilizes subprocesses measure segments 19-310 and network statistics per path 19-320to evaluate the viability of a path to be used to send the type oftraffic required. For example for very small sized data which requiresthe fastest path, then the shortest distance and lowest latency are ofmost importance and low bandwidth may be tolerated. Conversely for hugesized data which is not time sensitive in terms of delivery of the firstbit, the path offering the highest bandwidth is optimal because althoughfirst bit delivery is slower than the other path, last bit arrival isexpected to happen sooner due to the higher bandwidth.

The next process, Check route status 19-600, utilizes sub processesCompare routes 19-610 and Test: is total path complete 19-620 to ensurethe deliverability of data down that path.

The last process, Plot best route for traffic 19-700, utilizes subprocesses sub-algo: which is best path? 19-710 and Is this path best fortraffic type? 19-720 to determine and set the best route end-to-end.

Each process and sub process are utilized to ensure that each type oftraffic is carried most optimally by the tunnel best suited for thattraffic type.

FIG. 20 illustrates the functionality of a virtual interface VIF1 20-110with a traffic path and the advantages which it offers. Where FIG. 18illustrated the logical virtue of VIF as hook points for multipletunnels to various regions, this figure further describes a practicalapproach to organizing not just interfaces but also the various activetunnels and groupings of tunnels by tunnel life cycle event types. Themain tunnel life cycle event types are: Deprecated, Active, Being Built,and Standby.

Deprecated tunnels to be orderly destroyed 20-340 is where tunnels whichhad been built and either used or not used and are no longer to be used,are destroyed.

Active tunnels with routed traffic 20-300 is where healthy tunnels areup and connected, able to push traffic to one or more access pointservers (SRV_AP). A key advantage of having multiple active tunnelsconnected to a VIF is that an instantaneous switch of traffic from onetunnel to another tunnel can be made without any lost or leaked data.

Tunnels being built 20-310 is where new tunnels are being built betweenthe EPD 20-100 and an SRV_AP.

Standby tunnels ready for utilization 20-320 is where built tunnels areup and functional between the EPD 20-100 and an SRV_AP, but are not in aproduction state actively handling traffic. Tunnels in standby mode haveperiodic tests run on them to assess their viability and theiroperational state. They also are kept viable by pings or regular sendingof keep alive traffic.

The life cycle of tunnels attached to the VIF are that new tunnels getbuilt as needed, these new tunnels are put in standby and tested. Whenan active tunnel experiences a problem and needs to be deprecated anddestroyed, a standby tunnel can be turned active to replace it.Deprecated tunnels are destroyed in an orderly manner freeing resourcesfor future new tunnels to utilize.

FIG. 21 is a flowchart describing the algorithm governing when the flowof traffic should be switched from one tunnel to another tunnel. Thisassumes that at some point, the tunnel was viable. The step tunnel upand pushing data 21-100 is followed by a junction point 21-102 to TunnelTests 21-220. The Tunnel Monitor 21-200 is followed by a check is theTUN optimal? 21-300. If it is optimal, the path Yes 21-CP302 leads backto the junction point 21-102.

If the traffic is not optimal, the logic flows via path No CP304 to acheck any other tunnels available? 21-310 to check if there is anothertunnel available. If another tunnel does not exist, the logical path NoCP320 leads to Tunnel Builder: Create new tunnel 21-320 and once up, theprocess build routes for TUN 21-330 is executed. Alternatively, if atunnel does exist, then logical path Yes 21-CP352 leads or path fornewly created tunnel from 21-320 are sent to step tunnel test suite toevaluate alt. tunnel(s) 21-350. The process evaluate TUN switch 21-360compares the quality of service (QoS) for both tunnels.

The decision gate Switch to other TUN? 21-400 evaluates where or not itis worthwhile to switch the flow of traffic via Make TUN switch 21-510or to keep the traffic flowing through the current TUN via path NoCP308.

Parameters governing switch logic include tunnel tolerance which may beset by user preference, or algorithmic analysis of current conditions,or other factors. Tunnel condition logs can be used for comparison ofcurrent and historical metrics and can help to make most efficientcontextual switch decision making. Metrics of tunnel state also can beused for comparison of sets of tunnels relative to each other.

Type and nature of current traffic flowing through the tunnel such asthe volume of traffic, the likelihood that a switch would break the flowof traffic, and other factors are also considered when deciding whetheror not to switch to another tunnel.

FIG. 22 illustrates the logical structure of two virtual interfaces VIFconnected sequentially along a path, each with routes applied to sendtraffic down tunnels for a specific region. In this example, VIF0 forRegion A 22-110 traffic and VIF2 for Region B 22-150 traffic.

Each virtual interface has tunnels at various TUN life cycle stages asdescribed in FIG. 20 above. The utilization of virtual interfaces canoffer significant efficiency gains and there are advantages to buildingtunnels bound for one region on one specific VIF and tunnels for anotherregion on another VIF. For example, time consuming processes such asroute building can be done on the VIF, ahead of the TUN, so that whennew tunnels are built and/or existing ones are already available, thentraffic for the target region can be instantaneously switched from onetunnel to the other one. This also simplifies routing tables andresource management by applying them in one place, on the VIF ratherthan having to apply them to each and every individual tunnel.

FIG. 23 illustrates that time required for various tunnel (TUN) andvirtual interface (VIF) processes. The logical structure describes apath where traffic enters at Traffic in 23-100 to junction point 23-102.Two active VIF are connected via paths 23-P110 and 23-P120. VIF00 RegionA 23-110 links to tunnels destined for region A and VIF02 Region B23-120 links to tunnels destined for region B.

Two standby VIFs and corresponding tunnels are VIF06 Alt. Region A23-116 and VIF08 Alt. Region B 23-126. The difference between VIF00 andVIF06 is that the alternative standby VIF06 has only building 23-316 andstandby tunnels Standby 23-318.

For example—time consuming, rare, and slow procedures 23-540 and 23-520of building virtual interfaces, adding routes, and related processestake a lot of time but do not happen very often.

And since tunnel routing has been shifted upstream to the VIF, thetunnel operations are relatively extremely fast and often procedures23-530 and 23-500.

When one virtual interface such as VIF00 Region A 23-110 becomesunviable, then the logical flow of traffic 23-P110 can be shifted topath 23-P116 to the a standby VIF VIF06 Alt. Region A 23-116 inoperation with tunnels to that VIF's target region up and ready. Theshift from one VIF to another is an extremely fast and rare procedure23-510.

FIG. 24 illustrates the logical structure of multiple VIFs arrangedsequentially within a traffic path between traffic in 24-100 and othertraffic 24-140. Traffic for region A is sent down Active 24-300 tunnelsattached to VIF00 Region A 24-110 when the IP address of the targetdestination host device matches an address on a list of List of IPAddresses for Region A 24-610. The IP address list can include single IPaddresses, ranges of IP addresses, notational description of a rangesuch as CIDR, or other way to define location address of a host. Thelist 24_610 acts like a funnel sending all matches down tunnels, and theremaining unmatched traffic to the next leg in the logical sequence viaa link point between VIF's such as 24-112 to path 24-P120 to VIF02Region B 24-120.

Traffic at VIF02 Region B 24-120 is then checked against a List of IPAddresses for Region B 24-620. If there is a match, then traffic is sentdown an Active 24-302 tunnel. If no match, then the traffic continuesalong sequential path via 24-122 to the next VIF and so on.

If there is no match for traffic for Region A, Region B, or Region C,then it continues along the sequential path to Other traffic 24-140where it can either egress on the open internet, be captured in abuffer, blackholed, or otherwise routed.

FIG. 25 illustrates the logical structure of three virtual interfacesand their various tunnels to three different regions VIF00 Region A25-110, VIF02 Region B 25-120, and VIF04 Region C 25-130. In additionthis figure show the corresponding standby, alternative virtualinterfaces and standby tunnels VIF06 Alt. Region A 25-116, VIF08 Alt.Region B 25-126, and VIF10 Alt. Region C 25-136. Furthermore, thisfigure also shows the flow of traffic past the VIFs at Other traffic25-140 if there is no match of IP addresses for any of the targetregions.

FIG. 26 illustrates timelines for various tunnel (TUN) and virtualinterface (VIF) related operations.

Total Time: Regular Tunnel—to be built or rebuilt 26-180 outlines thetime and steps required to build and bring up a tunnel TUN0 26-100.

Total Time: VIF to be built or rebuilt and at least one TUN to be added26-280 outlines the time and steps required to build and bring up avirtual interface VIF0 26-200 and attach a first tunnel ready to pushtraffic.

Total Time: Tunnel on VIF—to be built or rebuilt 26-380 outlines thetime and steps required to build a subsequent tunnel TUN2 26-300 on to aVIF.

Total Time: Tunnel on VIF—switch traffic to 26-880 outlines the time andone step required to switch traffic from one tunnel to another tunnelTUN8 26-800 attached to a VIF.

Total Time: Tunnel on VIF—to be destroyed 26-380 outlines the time andstep required to deprecate a tunnel TUN4 26-400.

This figure is not to scale but shows the relative the time advantagesof building tunnels on to virtual interfaces with routing applied to theVIF upstream from the TUNs.

FIG. 27 is a flowchart that describes the algorithm governing thedecision making process of whether or not to switch from one virtualinterface to another virtual interface. Specifically the algorithm cancheck if the current VIF is optimal, if there is a path to the targetEIP, and if TUNs are optimal to decide if it is better to use thecurrent VIF or switch to an alternative.

FIG. 28 illustrates the logical structure of three virtual interfacesand their various tunnels to three different regions. FIG. 28 is similarto FIG. 25 and illustrates the switch from VIF02 Old Region B 28-120 toits standby VIF08 Region B 28-126.

For the VIF08 to be activated, the flow of traffic has to be routed via28-P120 to it. And from VIF08 Region B 28-126 to VIF04 Region C 28-130via path 28-P130.

As noted in FIG. 23 above, the switch between VIF's is an extremely fastand rare procedure 23-510. Once the decision to shift traffic is madevia algorithm as described in FIG. 27, then the shift of traffic isunimpeded and fast.

FIG. 29 is a flowchart that describes the algorithm governing theorderly destruction of a virtual interface (VIF). At the beginning ofthis process, before any action is taken, other factors are checked atstep 29-008 to ensure that the problem is with the VIF and not with someother factor. For example, if base internet connectivity goes down andcan't push traffic, there is very little point in destroying a virtualinterface and rebuilding the VIF because without a base internetconnection, the VIF will not be able to send or receive traffic.

It also ensures that an alternative VIF is available 29-116 and thatthis alternative VIF is available 29-210, connected 29-250 and if so viapath 29-CP260, then the process of destroying the VIF begins at 29-260.A final check is made to ensure that the VIF has actually been removed29-278.

If an alternative VIF is not available 29-210, the logic flows via path29-CP220 to a process to build 29-220 and to test the new VIF 29-230.

FIG. 30 illustrates how an encrypted tunnel protects data. TUN0 on GWD030-000 to GWD2 30-002 encrypts packets on GWD0 30-000 and decrypts themon GWD2 30-002. And for traffic in the other direction, packets areencrypted on GWD2 30-002 and decrypted on GWD0 30-000. If packets areintercepted in the middle, the encryption renders the payload of thetunnel packet as unreadable as illustrated by 30-ATTK00 and 30-ATTK02.However, if the packets are intercepted and their encryption is broken,then there is a risk that Stolen Data 30-444 is readable and able to bestolen.

FIG. 31 illustrates the security afforded by one tunnel TUN0 wrapped inanother tunnel TUN2. The differentiating factor between this figure andFIG. 30 is that all three attempts at data packet interception31-ATTK00, 31-ATTK02, and 31-ATTK04 result in failure. Even thoughattempt 31-ATTK04 in this figure is a successful breach of the outertunnel, the payload it steals is still encrypted 31-444.

FIG. 32 illustrates wrapped and capped tunnel. In the logical networkpath, the CAP is closest to the NIC. The CAP scrambles and unscramblespayloads at the bits-per-byte level.

In this example, 32-ATTK02 results in the interception of Scrambled Data32-444. The scrambler for the CAP can be based on exclusive disjunctionusing rotating keys and other logic to scramble the data payloads.

FIG. 33 illustrates an 8-bit byte scrambler on two gateway devices GWD0and GWD2. It shows how traffic's payload bits are scrambled anddescrambled per byte. The scrambling is dynamic and random protectingthe Scrambled Transit Byte 33-004.

FIG. 34 illustrates three different scramble phases for bit-scrambledbytes of a CAP. While there are only 256 potential combinations ofscrambled bits for an 8-bit system, a rotating key based on time orticks or other factors offer more protection.

FIG. 35 illustrates an internal tunnel through a series of wrappings andthen a CAP. The local flow from GWD0 35-000 enters the first tunnel TUN135-100, then into TUN2 35-200, and on into TUN3 35-300, and thenscrambled by CAP 35-600. When traffic enters GWD2 35-002 it flows intoCAP 35-602 to be descrambled, then from TUN3 35-302 out to TUN2 35-202out to TUN1 35-102 and then to 35-002.

This figure also describes packet bloat due to the extra layers ofsecurity which has the effect of reducing the payload's carry size.

FIG. 36 illustrates firewall-to-firewall tunnel traffic during a tunnelfailover. Firewall-to-firewall tunnel traffic through end point device(EPD) 36-100 can flow through one tunnel 36-CP202 to an access pointserver (SRV_AP) 36-202 or from the EPD to SRV_AP 36-200 via tunnel36-CP200 to device FWD2 36-002. The active tunnel was 36-CP200 but itwent down in the midst of pushing traffic with failover shifting trafficto TUN 36-CP202. Traffic from SRV_AP 36-200 egressed via egress ingresspoint EIP 36-210 to path 36-CP210. Traffic from SRV_AP 36-202 egressesvia EIP 36-212 to FWD2 36-002 via path 36-CP002. However, although theEPD knows how to route traffic to the new SRV_AP and the FWD2 36-002receives traffic it may still try to send it to path 36-CP210. This cancause the internal tunnel from FWD0 to FWD2 to be broken.

FIG. 37 illustrates firewall-to-firewall tunnel traffic during a tunnelfailover. FIG. 37 is similar to FIG. 36, with the addition of astructure to keep the routing between devices intact even after internaltunnel shifts to different network paths. EPD 37-100 allows for dynamicswitch from one TUN 37-CP200 to another 37-CP202. When traffic egressesvia EIP 37-218, the FWD2 37-002 can find the EPD regardless of whichinternal tunnel pathway is utilized.

FIG. 38 illustrates firewall-to-firewall tunnel traffic during a tunnelfailover. FIG. 38 illustrates the uninterrupted traffic flowing afterthe shift from the old TUN 38-CP200 (not shown) to 38-CP202. This isattributable to the fact that the FWD2 38-002 is able to find the returnpath back as the IP address it knows for the EIP 38-218 on SRV_AP 38-208remains the same regardless of a shift of internal traffic routing.

FIG. 39 illustrates the linking of two or more local area networks(LANs) LAN 000 LAN 002 into a wide area network (WAN). Unique subnetsare required to avoid conflicts. Automation and device to devicecommunication enable dynamically mapped networks and can prevent IPconflicts due to overlapping subnet ranges.

This mechanism can be used both to calculate IP addresses, IP addressrange assignments and other factors which can be used either byautomated systems, or can be the basis of messaging to networkadministrators for them to make manual configuration or to take otheractions.

FIG. 40 illustrates the importance of a server availability list and howIP addresses and ranges are assigned for various devices. Although IPv6offers a huge range of possible IP addresses, the IPv4 standard has afinite amount of both public and private IP addresses. This has aninfluence on which EPDs can connect with which SRV_APs.

In this figure, EPD 40-100 builds tunnels with SRV_APs 40-300, 40-302and 40-306. EPD 40-102 builds tunnels with SRV_APs 40-300, 40-304, and40-308.

This example demonstrates how the internal IP range 10.10.191.0 through10.10.191.255 can be used on two SRV_APs 40-302 and 40-304, and IP range10.10.192.0 through 10.10.192.255 can be used on both SRV_AP 40-306 and40-308.

Therefore for example, 10.10.191.18 can but used by EPD 40-100 to builda tunnel to SVR_AP 40-302 and at the same time 10.10.191.18 can also beused by EPD 40-102 to connect with SRV_AP 40-304.

EPD 40-100 and EPD 40-102 do not have to directly interact with eachother to avoid conflicts because the server availability list publishedfor each EPD in coordination with the TUN manager will assign IP address(internal and external) combinations for EPDs to connect with SRV_APswithout any conflicts.

FIG. 41 illustrates multiple parallel unique streams between devices.This example shows multiple parallel unique streams down four tunnelsused to concurrently send data between an EPD 41-100 and an SRV_AP41-300. Streams A, B, C, and D are sent separately and recombined on theother end. This multi-streaming is effective and efficient assuming thatthe base connectivity is of good quality. A, B, C, and D are presentedas an example. The actual number of parallel streams can be dynamicbased on carrying capacity of the line. This has a dependency on a cleanline.

FIG. 42 illustrates multiple parallel non-unique streams betweendevices. This example shows two separate duplicate streams so that twoA′s and two B′s are transmitted concurrently. If one or the other Apacket is lost and does not arrive, the other is still received. This isa key feature of stormy weather mode to keep data flowing during timesof packet loss.

Sending parallel streams consumes more traffic and bandwidth. However,during periods of unstable network connectivity, the traffic still getsthrough due to the redundancy. So in the event that a user has a 20 Mbpslast mile connection, if there is a high amount of packet loss on asingle stream the user experience (UX) may be less than idea due totimeouts, broken video streams, and other undesirable effects.

If a stream is duplicated, the effective size of the last mile pipe isreduced to 10 Mbps or less, however the data will get through improvingUX. As an extension of this, a for example if duplication of a stream isquadrupled, the bandwidth reduction is decreased fourfold. So a 20 Mbpscondition could be reduced to 5 Mbps or less, however, the link willcontinue to perform.

FIG. 43 illustrates the logical framework and algorithmic structure forstormy weather mode (SWM). The step fetch params 43-010 sets up theanalysis based on the attributes of the base connection and otherfactors. When dealing with packet loss 43-310, duplicate streams can beutilized to avoid loss and the need for subsequent retransmission.

If during periods of micro-outages 43-P330, the SWM can recognize thesituation, and keep the VIFs and TUNs up. Traffic may be buffered,connectivity kept alive, and when the outage is over, an orderly catchup with the stream by gently releasing content from the buffer.

The key to stormy weather mode taking action is to correctly understandthe conditions and to take appropriate remedial actions.

FIG. 44 illustrates multiple tunnels between devices within a globalvirtual network (GVN) across multiple regions. The EPD is in onelocation 44-MO. SRV_APs in region 44-M2 include SRV_AP 44-300, SRV_AP44-302, and SRV_AP 44-304. SRV_APs in region 44-M3 SRV_AP 44-310, SRV_AP44-312, and SRV_AP 44-314. Advanced smart routing (ASR) is used tomanage routing over the multiple tunnels and paths between the EPD andthe various SRV_AP devices. ASR can mitigate the risk of looping, wronggeographic destination routing, ASR remote redirect backtrack, brokenlinks between SRV_APs, regions, and other problems.

FIG. 45 illustrates potential problems with bottlenecks through a hopbetween two network segments. During the serving of a file from a serverto a client, certain algorithms govern the bandwidth of the transferbased on the end-to-end line carrying capacity. Should the burst oftraffic be too high, the server throttles back on the bandwidth toenable the most efficient transfer mitigating loss due to congestion.This may result in the server being a good and responsible citizen withrespect to pipe use but this can also result in an overly aggressivegoverning of bandwidth significantly slowing the transfer well below theactual end-to-end line carrying capacity.

When a server begins to serve a stream of data or a file, it will blastmany packets per second based on what it assumes to be the highbandwidth of a network segment 45-100. The server is connected to thislarge pipe network segment.

If the data stream is constricted at 45-300, it forces the server toaggressively throttle down the stream slowing transfer, and due to theneed to retransmit the lost packets, the server may reduce rate oftransfer overly aggressively slowing down the total process.

FIG. 46 illustrates the organizing and reporting of information on theSRV_CNTRL. This information includes an analysis of ports per IP addressto each SRV_AP, the quality of service (QoS) and rates each port overtime. This information can be used to compare group of ports to eachother and to identify patterns over time and in intersectingseries/sets.

FIG. 47 is a flowchart that describes the logic used for tunnel tests.There are tests done on the current tunnel 47-110, tests done on thebase connection outside the tunnel 47-120, tests outside tunnel to analternative SRV_AP 47-120, and tests run on TUNs to alternative SRV_APsin the same region 47-140. By comparing the tests to each other,comparisons of QoS between base connection and tunnel, alternativetunnel, and more can be ascertained.

FIG. 48 illustrates the running of parallel tunnel tests to measurelatency 48-100, bandwidth 48-110, packet loss 48-120, and other factors48-150.

After testing, other processes are run at post-running of tests to cleanup, and free resources 48-300. At the end of testing, log test results48-320 saves pertinent information.

FIG. 49 illustrates running connectivity tests without interfering withcurrent user tunnel usage. Before any testing cycles begin, analyzecurrent use 49-1100 examines the current usage of the connectivity byusers, by type of traffic as well as which traffic stays local and whichtransits via a tunnel.

The next step allocates and uses free capacity to run tests 49-1200 sothat the tests do not steal bandwidth from users which could have adetrimental effect on their UX.

At the analyze connectivity 49-1300 step, both the connectivity testsand real user usage are taken into account in aggregate and individuallyto analyze connectivity.

Tests run during work hours when a “production” network is busy will berun in a manner where they do not effect work flow. Test runs during offhours may not provide accurate information of a broader network underload because they can't detect individual congestion issues which occurwhen multiple parties are also using network resources.

Tests run on a busy network may interrupt workflow and while necessaryto diagnose problems, if run too often and given right to monopolize toomany resources, then the test could become a contributing factor to theproblem.

Total network usage can be measured by analyzing traffic down path49-CP306.

Local only traffic may be ascertained by totaling all tunnel traffic andsubtracting that sum from the traffic through 49-CP306 with theremainder being local traffic.

FIG. 50 illustrates interaction between three devices which collaboratein the process of tunnel building. The three device are an end pointdevice (EPD) 50-100, an access point server (SRV_AP) 50-300 and acentral control server (SRV_CNTRL) 50-200. This figure show the logicalstructure of the devices, the key components running on each device, aswell as the API framework for communications between them.

In order for tunnel TUN 50-100300 to be built, certain information aboutthe tunnel, about the peers in the pairing, and other information can beshared by the API.

Information about which SRV_AP 50-300 an EPD 50-100 should connect withis available via a server availability list which is generated on theSRV_CNTRL 50-200.

The tunnel is initiated on the EPD 50-100 by the Tunnel Builder 50-112.It is governed by the Tunnel Manager which in turn gathers informationfrom Tunnel Info 50-116 for settings, Index of tunnels 50-118, and savetunnel information 50-122.

The tunnel listener 50-312 operates on the SRV_AP 50-300 and is governedby the tunnel manager 50-310. Information on each device can be storedin RAM, in a database 50-B100, 50-B300, and 50-B200, or on a disk50-H100 or 50-H300, or other form of storage (not shown).

FIG. 51 illustrates the relationships between various database tablesused to store connectivity information. The connectivity information isused to make tunnels 51-210, tunnel information 51-220, and ServerAvailability 51-280. More tables may be used, and the fields andrelationships indicated are for example only and can differ depending onuse within various systems.

FIG. 52 illustrates the requirement for unique information per tunnel toavoid collisions. This information can include the tunnel name, tunnelID, tunnel interface name, the port number listened to on a specific IPaddress, and should to be unique to each tunnel.

This figure illustrates the connection from devices to the SRV_AP52-300, such as EPD 52-100 to port 26158 via 52-P100, EPD 52-102 to port9836 via 52-P102, from PEPD 52-110 to port 45373 via 52-P110, EPD 104 toport 33172 via 52-P104, PEPD 52-112 to port 15942, and EPD 52-106 toport 51625 via 52-P106.

The tunnel listener 52-312 will only open those ports to which itexpects tunnels to be built upon and will close the rest. Furthermore,only connections from known peers will be accepted. The ports assignedto TUNs via the server availability mechanism are unique and random. Thetype of tunnel cannot be identified by the port used. Unique,non-conflicting subnets will also be assigned via the tunnel listenergoverned by the server availability listing and tunnel manager 52-310.

FIG. 53 is a flowchart illustrating the logical flow used to assign aport to an IP address used to build a tunnel. The flow takes intoaccount various factors when selecting the port and IP address to use.

The first step is to gather parameters 53-010 for the port to IP addressassignment by checking to see if desired port and IP_Address have beenspecified to be used by a specific device by its Device_ID, and otherfactors. The parameters also delineate a floor value and a roof valuefor port number, and more governing settings.

The logic gate IP+Port specified? 53-020 step checks to see if there isa request for a specific port attached to a specific IP address for aserver device by Device_IP.

If the port and IP address have been specified, then the availabilityfor their use is accepted and logic follows path Yes 53-P022. If apreferential port and IP are not specified then logic follows path No53-P030 to random number generator for a random port to be generatedwithin range 53-030.

A lookup is done at step 53-050 to check against current and historicaluse (via path 53-B102 to Db Registry 53-B100) for that port to IPaddress mapping to see if the port is free or if it is currently in use.A secondary check is done by looking at historical use to see if itindicates if that port and IP combination has been used in the past bythis device or other devices, and if so, if that use proved to berelatively problematic. Some unstable or unreliable ports due tofiltering or congestion through devices or other reasons can be markedas being problematic. If there is also a trend for blocking ofproblematic ports for other devices, then the port to IP addresscombination can be marked as unavailable.

If the port is not available at step 53-060, the process of generating aport to IP address mapping is restarted via junction point 53-012.

If the port is available, then the port to IP address will be assignedfor use at step 53-100. This assignment will be saved in the Db registry53-B100 via path 53-B112. Next, the Port to IP Address assignment ispublished via an API call 53-120 so that relevant devices know about theavailability status of the port. The last step is to log the assignment53-130 of port to IP address including the logic used and other factorswhich could assist in improving the efficiency of future portassignments.

FIG. 54 is a flowchart describing a structure for a series of tests ofvarious ports of an IP address. The structure includes a while loop thatwill continue as long as the counter VAR is less than the prescribednumber of tests to run. Results per test are saved in amulti-dimensional array or saved to database or log file.

At the process results, add to results array, prep for log 54-090 step,ongoing statistical analysis can be run on the current test comparedwith the other tests run in the series.

FIG. 55 is a flowchart that shows the logic regarding the management ofpeer pair relationships between devices. The algorithm checks to see ifthere is a relationship in place 55-020, if it is up-to-date 55-030, andalso checks to see if there are adequate rights to create 55-130 and orupdate 55-100 the relationship. If a new relationship is created or anexisting one is updated, an API call 55-220 via the SRV_CNTRL shares theinformation with the other peer in the pair.

FIG. 56 illustrates the steps used set up and then run tunnel tests.This is an alternative to the operation as described by FIG. 54.

FIG. 57 illustrates a virtual end point (VEP) extended into the cloud.The VEP is reachable by either dedicated IP address via path 57-CP000 to57-CP010 or an IP address+port combination via paths 57-CP002 to57-CP-012.

The egress ingress point (EIP) 57-212 on an access point server (SRV_AP)57-202 will carry traffic received at the specific port on the IPaddress via path 57-CP010 through the tunnel TUN 57-202 to EPD 57-100via LAN 57-102 to the LAN Device 57-108.

If no port is specified, the traffic via 57-CP012 Dedicated IP addresscan be forwarded to the EPD 57-100 and can be handled via 57-118.

FIG. 58 illustrates the binding of a domain name to a dynamic VEP on aSRV_AP 58-202. This allows traffic to “find” the EIP 58-212 after thedomain name is looked up by a domain name server (SRV_DNS) 58-022. Finergranularity of routing occurs at a nameserver server (SRV_NS) 58-028.This mechanism allows for a DomainName.gTLD mapped to this EPD 58-118.

FIG. 59 illustrates the routing of traffic for a domain.gTLD to enter aglobal virtual network (GVN) via the most optimal egress ingress point(EIP). The most optimal egress ingress point (EIP) may be egress ingresspoint 59-312 on access point server (SRV_AP) 59-310 or EIP 59-322 onSRV_AP 59-320. Traffic from either SRV_AP 59-310 or SRV_AP 59-320 willroute to the EPD 59-100 via the most optimal path through the GVN.Conversely return traffic is smart routed back.

FIG. 60 illustrates a registry of end point devices (EPD) and personalend point devices (PEPD) which can be located and reached via adomain.gTLD.

gTLD stands for global top level domain. The registry further storesinformation for individual devices located in the local area network(LAN) behind an EPD or a personal area network (PAN) behind a PEPD. Forexample PC.domain100.gTLD will find PC 60-128 via path 60-P128 which isin the internal network behind EPD 60-100. Security settings can alsogovern whether or not devices within a LAN are reachable from the openinternet, or only from known source IP addresses, or only from withinthe GVN, or from known EPD's, or via other rules.

FIG. 61 illustrates devices which may be reachable via a subdomain of aglobal top level domain. This example shows devices reachable bysubdomain.domainname.gTLD such as Server 61-126 viaServer.Domain100.gTLD behind EPD 61-100. However, LAN Device 61-108 isnot assigned a subdomain and therefore is not reachable from outside viaa virtual end point (VEP).

FIG. 62 illustrates a method for utilizing a graphic user interface(GUI) running in a browser on a Client Device to manage virtual endpoint information. The user interface (GUI) 62-028 is run in a browseron a Client Device 62_118. The client in the GUI can connect via Host62-102 on the EPD 62-100 or Host 62-222 hosted on SRV_CNTRL (public)62-220.

The list of domains.gTLD and associated subdomains is managed and upon“saving” or “committing”, the changes are shared to SRV_CNTRL (Internal)Repository 62-200 via its API 62-222 to be saved in the database there62-B300. The VEP Manager 62-380 publishes this information to the domainregistrar server (SRV_DREG) 62-026, the domain name server (DNS) server(SRV_DNS) 62-022, and to the nameserver server (SRV_NS) 62-028.

FIG. 63 illustrates how subdomains.domains.gTLD routing can takeadvantage of advanced smart routing (ASR) in a global virtual network(GVN). This can be used to both find the most optimal egress ingresspoint (EIP) from the open internet 63-010 or 63-050 as well as utilizingASR to use the most optimal internal route through the GVN. ASR canutilize a combination of both external paths and internal paths viatunnels to select the most ideal path end-to-end.

FIG. 64 shows a block diagram of technology used by and enabled by aglobal virtual network (“GVN”) including the GVN core elements G0, GVNmodules G100, and technology enabled G200 by the global virtual networkGVN. The GVN core includes an overview of the mechanism G1 and itsconstituent component parts of Topology G2, Construct G3, Logic G4, andControl G5 layers. The GVN core G0 also incorporates the relations toand with GVN Elements G6.

The GVN can include plug-in and/or stand-alone GVN modules G100including but not limited to: Neutral API Mechanism (“NAPIM”) G102,described in PCT/US16/12178; Geodestination (“Geo-D”) G104, described inPCT/US15/64242, Advanced Smart Routing (“ASR”) G106, Connect G108, andother modules G110 described in U.S. Provisional Application 62/151,174.

The GVN also provides a platform which can enable other technologiesincluding but not limited to: Network Tapestry G202; MPFWM G204; NetworkSlingshot G206; Network Beacon G208, Granularity of a tick G210, andother technologies G212. These are described in U.S. ProvisionalApplication 62/174,394, U.S. Provisional Application 62/266,060.

GVN Modules (G100) and Technology (G200) enabled by GVN can operate ontop of an existing GVN, as a component part of a GVN, or can beindependent and utilize all or some isolated parts of a GVN to supporttheir own stand-alone operations.

FIG. 65 illustrates some system modules and components for an end pointdevice EPD 100, central control server SRV_CNTRL 200, and an accesspoint server SRV_AP 300. This figure also illustrates database 5100 onEPD 100, database 5200 on SRV_CNTRL 200, repository database 5202 onSRV_CNTRL 200, and database 5300 on SRV_AP. The figure is hierarchical,with lowest level hardware devices at the bottom, and subsequentsystems, components, modules and managers built on top of lower layers.Files and data are stored on the Hierarchical File System (HFS) attachedstorage devices 65-H100 on EPD 100, 65-H200 on SRV_CNTRL 200, and65-H300 on SRV_AP 200. The components illustrated in these systemsdiagrams all operate independently but may also rely on informationabout other devices that they interact with.

RAM stands for random access memory, CPU for central processing unit(which can also include sub-processors), NIC for network interface card,Db for database software, DNS for domain name system, HOST for hostingsoftware, API for application programming interface, ASR for advancedsmart routing, GeoD for geodestination, GVN for global virtual network,CDA for content delivery agent, CPA for content pulling agent, and RFBOT for remote fetcher bot. There may be additional modules, mangers,systems, or software components.

FIG. 66 illustrates some system modules and components for an end pointdevice EPD 100, central control server SRV_CNTRL 200, and an accesspoint server SRV_AP 300. This figure further identifies subsystems foreach device such as EPD sub-sys 1000 for EPD 100, SRV_CNTRL Sub-sys 2000for CNTRL 200, and SRV_AP sub-sys 3000 for SRV_AP 300. Subsystems havebeen identified by function and are indicated with prefixes including FWfor firewall related subsystems, TUN for tunnel related subsystems, VIFfor virtual interface related subsystems, SRV_Avail for the serveravailability list and related subsystems, BUFF Mgr for buffer managementand related subsystems, LOG for the logging module and relatedsubsystems, and CONNECTIVITY for general connectivity operations.

FIG. 67 illustrates some system modules and components for an end pointdevice EPD 100, central control server SRV_CNTRL 200, and an accesspoint server SRV_AP 300. Subsystems have been identified by function andare indicated with prefixes including Connectivity for generalconnectivity operations, ASR for advanced smart routing, API forapplication programming interface, LOG for the logging module andrelated subsystems, GeoD for the geodestination module and relatedsubsystems, SRV_Avail for server availability list and relatedsubsystems, Buffer for buffer management and related subsystems.

The invention claimed is:
 1. A network system for connecting devices viaa global virtual network, comprising: an endpoint device comprising atleast one tunnel manager and a first virtual interface; and an accesspoint server comprising at least one tunnel listener and a secondvirtual interface, the at least one tunnel listener being connected tothe at least one tunnel manager via a communication path comprising oneor more tunnels wherein each tunnel connects one tunnel manager and onetunnel listener, and wherein at least two tunnels of the one or moretunnels are in an active state; wherein the first virtual interfaceprovides the endpoint device a logical point of access to the one ormore tunnels; wherein the second virtual interface provides the accesspoint server a logical point of access to the one or more tunnels;wherein at least one of the first virtual interface or the secondvirtual interface are configured to: detect a failure of a first tunnelamong the one or more tunnels; determine whether another tunnel amongthe one or more tunnels is available in response to detecting thefailure; dynamically create a new tunnel connecting the at least onetunnel manager to the at least one tunnel listener in response todetermining that another tunnel is not available; and switch trafficfrom the first tunnel to the new tunnel; and wherein the at least twotunnels in the active state concurrently send unique streams of databetween the endpoint device and the access point server during periodsof low packet loss, and concurrently send duplicate streams of databetween the endpoint device and the access point server during periodsof high packet loss.
 2. The network system according to claim 1, whereinthe communication path further comprises two or more tunnels; wherein atleast one tunnel is in the active state; and wherein at least one tunnelis in the being built, standby, or deprecated state.
 3. The networksystem according to claim 2, wherein the at least one tunnel is in thestandby state and is periodically tested to assess its viability andoperational capability.
 4. The network system according to claim 2,wherein the at least one tunnel in the active state is periodicallytested to assess its viability and operational capability.
 5. Thenetwork system according to claim 2, wherein the at least one tunnel isin the standby state and is kept alive with at least one of pings orkeep alive traffic.
 6. The network system according to claim 2, whereinat least one tunnel in the active state is transitioned to thedeprecated state and the least one tunnel in the standby state istransitioned to the active state.
 7. The network system according toclaim 2, wherein the at least one tunnel in the active state isperiodically tested to assess its viability and operational capability;wherein at least one tunnel is in the standby state and is periodicallytested to assess its viability and operational capability; and whenquality of service (QoS) indicates that the at least one tunnel in thestandby state is the optimal tunnel then at least one tunnel in theactive state is transitioned to the deprecated state and then at leastone tunnel in the standby state is transitioned to the active state. 8.An access point server for network communication via a global virtualnetwork, comprising: at least one tunnel listener; and a virtualinterface; wherein the access point server communicates with a networkdevice through a communication path comprising one or more tunnels,wherein each tunnel connects to one tunnel listener, and wherein atleast two tunnels of the one or more tunnels are in an active state;wherein the virtual interface provides the access point server a logicalpoint of access to the one or more tunnels; wherein the virtualinterface is configured to: detect a failure of a first tunnel among theone or more tunnels; determine whether another tunnel among the one ormore tunnels is available in response to detecting the failure;dynamically create a new tunnel connecting the to the at least onetunnel listener in response to determining that another tunnel is notavailable; and switch traffic from the first tunnel to the new tunnel;and wherein the at least two tunnels in the active state concurrentlysend unique streams of data between the endpoint device and the accesspoint server during periods of low packet loss, and concurrently sendduplicate streams of data between the endpoint device and the accesspoint server during periods of high packet loss.
 9. A network system forconnecting devices via a global virtual network, comprising: an endpointdevice comprising at least one tunnel manager and a first virtualinterface; a plurality of access point servers each comprising at leastone tunnel listener and a second virtual interface, the at least onetunnel listener being connected to the at least one tunnel manager via aplurality of communication paths each comprising one or more tunnels,wherein each tunnel connects one tunnel manager and one tunnel listener,and wherein at least two tunnels of the one or more tunnels are in anactive state; wherein the first virtual interface provides the endpointdevice a logical point of access to the one or more tunnels; wherein thesecond virtual interface provides the respective access point server alogical point of access to the one or more tunnels; and wherein at leastone of the first virtual interface or the second virtual interface isconfigured to: detect a failure of a first tunnel among the one or moretunnels; determine whether another tunnel among the one or more tunnelsis available in response to detecting the failure; dynamically create anew tunnel connecting the at least one tunnel manager to the at leastone tunnel listener in response to determining that another tunnel isnot available; and switch traffic from the first tunnel to the newtunnel; and an advanced smart routing module configured to managerouting over the plurality of communication paths between the endpointdevice and the plurality of access point servers; and wherein the atleast two tunnels in the active state concurrently send unique streamsof data between the endpoint device and the access point server duringperiods of low packet loss, and concurrently send duplicate streams ofdata between the endpoint device and the access point server duringperiods of high packet loss.
 10. The network system according to claim9, wherein the first virtual interface and the second virtual interfaceare hook points for the one or more tunnels to various regions.
 11. Thenetwork system according to claim 9, wherein the first virtual interfaceand the second virtual interface have tunnels at various life cyclestages.
 12. The network system according to claim 9, wherein at leastone of the one or more tunnels is wrapped in another tunnel.
 13. Thenetwork system according to claim 12, wherein the at least one of theone or more tunnels is capped.
 14. The network system according to claim9, wherein the at least one of the one or more tunnels is capped. 15.The network system according to claim 9, wherein the endpoint device andat least one of the access point servers is configured to maintainparallel non-unique streams between one another to keep data flowingduring times of packet loss.
 16. The network system according to claim9, wherein at least one of the plurality of communication paths furthercomprises two or more tunnels; wherein at least one tunnel is in theactive state; and wherein at least one tunnel is in the being built,standby, or deprecated state.
 17. The network system according to claim16, wherein the at least one tunnel is in the standby state and isperiodically tested to assess its viability and operational capability.18. The network system according to claim 16, wherein the at least onetunnel in the active state is periodically tested to assess itsviability and operational capability.
 19. The network system accordingto claim 16, wherein the at least one tunnel is in the standby state andis kept alive with at least one of pings or keep alive traffic.
 20. Thenetwork system according to claim 16, wherein at least one tunnel in theactive state is transitioned to the deprecated state and the least onetunnel in the standby state is transitioned to the active state.
 21. Thenetwork system according to claim 16, wherein the at least one tunnel inthe active state is periodically tested to assess its viability andoperational capability; wherein at least one tunnel is in the standbystate and is periodically tested to assess its viability and operationalcapability; and when quality of service (QoS) indicates that the atleast one tunnel in the standby state is the optimal tunnel then atleast one tunnel in the active state is transitioned to the deprecatedstate and then at least one tunnel in the standby state is transitionedto the active state.